We consider a confidence parametrization of binary information sources in terms of appropriate likelihood ratios. This parametrization is used for Bayesian belief updates and for the equivalent comparison of binary experiments. In contrast to the standard parametrization of a binary information source in terms of its specificity and its sensitivity, one of the two confidence parameters is sufficient for a Bayesian belief update conditional on a signal realization. We introduce a confidence-augmented receiver operating characteristic for comparisons of binary experiments for (...) a class of “balanced” decision problems, relative to which the confidence order offers a higher resolution than Blackwell’s informativeness order. Where observation is concerned, Chance favors only the prepared mind.—Louis Pasteur (1822–1895). (shrink)

It is natural for humans to judge the outcome of a decision under uncertainty as a percentage of an ex-post optimal performance. We propose a robust decision-making framework based on a relative performance index. It is shown that if the decision maker’s preferences satisfy quasisupermodularity, single-crossing, and a nondecreasing log-differences property, the worst-case relative performance index can be represented as the lower envelope of two extremal performance ratios. The latter is used to characterize the agent’s optimal robust decision, which has (...) implications both computationally and for obtaining closed-form solutions. We illustrate our results in an application which compares the performance of relative robustness to solutions that optimize worst-case payoffs, maximum absolute regret, and expected payoffs under a Laplacian prior. (shrink)